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SPECIFICATION 

TITLE OF INVENTION 
FAST LIFETIME ANALYSIS OF OBJECTS IN A GARBAGE-COLUECTED SYSTEM 

FTRf n nP THE INVENTION 
[0001] The present invention relates to the field of computer science. More paiticularly. the 
present invention relates to detennining the lifetime of objects in a gaibage-coUected syst^. 

BACKGROUND OF THE INVENTION 
[0002] In compute- science, gaihage collection refers to the lecovoy of pooled computer 
storage that is being used by a program when that program no longer needs the storage. The 
garbage collection routine searches memory for data that are no longer active in order to reclaim 
the space. This frees the storage for use by other programs (or processes within a program). It 
also ensures that a program using increasing amounts of pooled storage does not reach a quota. 

[0003] Garbage collection routines are typically encoded when a program is created. In 
some cases, the routines may even be embedded into hardware or flash memory. TTius, it is 
increasingly important to verify that the most efficioit and accurate garbage collection routines 
are found before they are implemented, as modification after implementation may be difficult or 
impossible. Since different programs have different optimal garbage collection routines, it is 
important to test garbage collection techniques on specific programs befcMe implementation. 
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[0004] Performance analysis of the garbage collection technique during creation or fine- 
tuning allows the developer to test the efficiency and accuracy of the technique. Typically, the 
lifetime of the objects is measured by forcing a complete garbage collection after each mutation 
of the object graph. FIG. 1 is a diagram illustrating an example of an object graph. Roots 100, 
102 may point to objects 104, 106. Each time the object graph changes, there is the potential that 
one or more of the objects may "die". An object is considered dead if it is no longer reachable 
fiom a root. Forcing a garbage collection after each mutation fully updates the system, thus 
information on when an object dies can easily be recorded. 

[0005] Additionally, it is often useful to have precise lifetime information in order to analyze 
the program itself, such as by providing a histogram of the lifetimes of various objects within the 
program. 

[0006] However, measuring the lifetime of each object in this maimer is fairly processor- 
intensive. The time it takes to run a garbage collection grows in proportion to the size of the 
object graph. In order to avoid this oveihead, it is typical to only force a garbage collection 
periodically, for example after every thousand mutations. However, there is significant loss in 
precision in the lifetime analysis when this periodic measurement is undertaken. 

[0007] What is needed is a solution for effectively and efficiently computing precise object 
lifetimes. 
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RRmP DRSCRIPnON OF THE INVENTION 
[0008] The analysis of the lifetime of objects in a garbage-collected system may be 
accomplished quickly and effectively using reference counts and cyclic garbage analysis. A 
reference count is maintained for each of the objects to indicate the number of incoming pointers. 
Each time the graph structure is altered, the reference counts are updated. Timestamps are 
recorded each time the reference count for objects change. If a reference count goes to zero, the 
corresponding object may be indicated as dead. A garbage collection need only be run once 
(perhaps at the end), and after it is mn the system may indicate which objects are cyclic garbage. 
TTie timestamps for objects which are cyclic garbage are then reviewed in reverse chronological 
order. For each timestamp found, the corresponding object and any object reachable from the 
corresponding object are indicated as dead. These objects are then removed from the set of 
cyclic garbage. 
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RRTHF DESCRIPTION OF THE DRAWINGS 
[0009] The accompanying drawings, which are incorporated into and constitute a part of this 
specification, illustrate one or more embodiments of the present invention and, together with the 
detailed description, serve to explain the principles and implementations of the invention. 

[0010] In the drawings: 

HG. 1 is a diagram illustrating an example of an object graph. 

FIG. 2 is a block diagram illustrating an object graph having reference counts in 
accordance with a specific embodiment of the present invention. 

HG. 3 is a block diagram illustrating a dead cycle 

FIG. 4 is a diagram illustrating a graph structure having a cycle within another cycle. 

FIG. 5 is a flow diagram illustrating a method for measuring the lifetime of objects in a 
garbage-collected system, the objects organized in a graph structure, in accordance with a 
specific embodiment of the present invention. 

FIG. 6 is a flow diagram illustrating a method for measuring the lifetime of objects in a 
garbage-collected system, the objects organized in a graph structure, in accordance with a 
specific embodiment of the present invention. 
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FIG. 7 is a block diagram illustrating an apparatus for measuring the lifetime of objects in 
a garbage-collected system, the objects organized in a gr^h structure, in accordance with a 
specific embodiment of the present invention. 

FIG. 8 is a block diagram illustrating an ^paratus for measuring the lifetime of objects in 
a garbage-collected system, the objects organized in a graph structure, in accordance with a 
specific embodimrat of the present invention. 
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nFTAn DESCRIPTION 
[0011] Embodiments of the present invention are described herein in the context of a system 
of computers, servers, and software. Those of ordinary skill in the art will realize that the 
following detailed description of the present invention is illustrative only and is not intended to 
be in any way limiting. Other embodiments of the present invention will readily suggest 
themselves to such skilled persons having the benefit of this disclosure. Reference will now be 
made in detail to implementations of the present invention as illustrated in the accompanying 
drawings. The same reference indicators will be used throughout the drawings and the following 
detailed description to refer to the same or like parts. 

[0012] Li the interest of clarity, not all of the routine features of the implementations 
described herein are shown and described. It will, of course, be appreciated that in die 
development of any such actual implementation, numerous implementation-specific decisions 
must be made in order to achieve the developer's specific goals, such as compliance with 
application- and business-related constraints, and that these specific goals will vary from one 
implementation to another and from one developer to another. Moreover, it will be appreciated 
that such a development effort might be complex and time-consuming, but would nevertheless be 
a routine undertaking of engineering for those of ordinary skill in the art having the benefit of 
this disclosure. 

[0013] In accordance with the present invention, the components, process steps, and/or data 
structures may be implemented using various types of operating systems, computing platforms, 
computer programs, and/or general purpose machines, in addition, those of ordinary skill in the 
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ait will recognize that devices of a less general purpose nature, such as hardwired devices, field 
programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), or the like, 
may also be used without departing from die scope and spirit of the inventive concepts disclosed 
herein. 

[0014] A specific embodiment of the present invention may be executed using a Java™ 
Virtual Machine created by Sun Microsystems, Inc. of Palo Alto, California. Howevw, one of 
ordinary skill in the art will recognize that the present invention may be implemented using a 
variety of different systems and need not be limited to specific examples provided in this 
document. 

[OOliS] In a specific embodiment of the present invention, a solution is provided wherein time 
stamps of mutations are tracked. When a garbage collection is run, the system may then 
backtrack to determine when it was that certain objects became garbage. This i»x>vides 
extremely accurate lifetime measurements for use in garbage collection technique analysis. It 
also significantly reduces processor time as the garbage collection need only be run once (at the 
end). 

[0016] It should be noted that while only one garbage collection needs to be run, 
implementations are possible where multiple garbage collections are run. Additionally, it should 
be noted that while in a specific embodiment of the present invention, the lifetime analysis is 
only performed after all of the garbage collections have been run, embodiments are possible 
where the lifetime analysis is performed afto^each individual garbage collection. 
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[0017] In a specific embodiment of the present invention, reference counts are maintained 
for each object in the object graph. Reference counts are values stored that indicate the number 
of incoming pointers to an object. Reference counts are modified as the graph is modified, and 
when a reference count goes to zero, it is clear the object is unreachable from the root (as it is 
unreachable from any node). FIG. 2 is a block diagram illustrating an object graph having 
reference counts in accordance with a specific embodiment of the present invention. Each object 
200 has a stored reference count 202. When one of the links is modified and removed, the 
reference count of the object to which it was pointing is decremented. If a reference count equals 
zero, it means that it has no incoming pointers and thus is dead. 

[0018] However, reference counting alone does not always ensure accurate lifetime analysis. 
This is because reference counting has trouble identifying dead cycles. A dead cycle is one in 
which each object points to another object in the cycle, but no incoming links enter the cycle 
itself. FIG. 3 is a block diagram illustrating a dead cycle. This diagram is identical to FIG. 2, 
except the incoming link to cycle 300 has been removed and the corresponding reference count 
of 302 has changed accordingly. However, none of the reference counts for 302, 304, or 306 are 
equal to zero. Therefore, reference counting alone would not recognize that 302, 304, and 306 
are garbage. 

[0019] In a specific embodiment of the present invention reference counting is utilized to 
determine when normal objects die. However, in the special case of objects which are part of 
cycles, a specialized technique is used wherein the timestamps of changes to the cycles are 

9 



EV310857856US Docket No.: SUN-P7064CNT1 

examined in reverse chronological order in order to detennine when objects within a cycle die. 
This is most efficiently accomplished at the time of a garbage collection. Therefore, as a graph 
stracture changes, timestamps record the changes and reference counting may be used to tell 
when objects die. Then, when a garbage collection is run, the timestamps corresponding to the 
remaining objects still listed as alive are examined and an object is listed as dead if its refa:ence 
count is zero or it is cyclic garbage. After garbage collection is run, the system may then go 
back through the objects listed as dead and label any object with a reference number higher than 
zeit) as cyclic garbage. One of ordinary skill in the art will recognize, however, that the garbage 
collection and the cyclic garbage labeling could be combined into a single step. 

[0020] The timestamps are then examined in reverse chronological order, thus the last 
change to an object within the cycle will be encountered first. The timestamp of the last change 
to an object within a cycle is deemed to be the timestamp at which all objects in the cycle died. 
Therefore, all objects in that cycle are listed as dead as of that time, and then all the timestamps 
corresponding to objects in that cycle are removed from the list of remaining timestamps to be 
examined. Eventually, all the cycles will have been examined and a precise timestamp of when 
each dies will have been indicated. This ensures that both cyclic and non-cyclic garbage have 
accurate lifetime calculations. 

[0021] The reason for removing all objects listed as dead from the list of objects which are 
gaibage is so that the lifetimes are accurately computed for all objects within the cycle as well as 
to handle cases where cycles may be contained within other cycles. FIG. 4 is a diagram 
illustrating a graph structure having a cycle within anotfier cycle. This figure has the cycles 
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identified Cycle 400 may be contained within larger cycle 402. If the link from 404 to 406 is 
removed, suddenly entire cycle 402 is dead. However, if just the link from 408 to 410 is 
removed, only cycle 400 is dead, and objects 406, 408, and 412 are still alive and remain in cycle 
402. 

[0022] HG. 5 is a flow diagram illustrating a method for measuring the lifetime of objects in 
a garbage-collected system, the objects organized in a graph structure, in accordance with a 
specific embodiment of the present invention. At 500, a reference count is maintained for each 
of the objects, the reference count indicating the number of incoming pointers to each object. At 
502, the reference counts are updated each time the graph structure is altered. At 504, a 
timestamp is recorded for an object each time the reference count for the object changes. The 
timestamp may be a counter that is incremented on every pointer store. It may be stored in a 
record generated each time a change is made to the graph structure. At 506, an object is 
indicated as dead when its reference count goes to zerol At 508, a garbage collection is 
executed, the garbage collection indicating one or more objects which are cyclic garbage. A 
tracing collector may be utilized to detect when objects are cyclic garbage. Specifically, a mark- 
sweep collector may be used. Then, at 510 the timestamps for each of the objects which are 
cyclic garbage are reviewed in reverse chronological order. For each timestamp found, 512-516 
are executed. At 512, the object corresponding to the timestamp is indicated as dead. At 514, 
any object reachable from the object corresponding to the timestamp is also indicated as dead. 
Then, at 516, any objects that have been indicated as dead are removed from the objects which 
are cyclic garbage. The lifetime of the object may then be the period between the time it is 
created and the time it dies, the time it dies being measured by wheri its corresponding reference 
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count goes to zero or the time it was indicated the object was dead The reviewing may be 
repeated each time a garbage collection is executed. 

[0023] HG. 6 is a flow diagram illustrating a method for measuring the lifetime of objects in 
a gaibage-coUected system, the objects organized in a graph structure, in accordance with a 
specific embodiment of the present invention. In this embodiment, the reference counts are only 
examined when the garbage collection is executed. TTius, it is not necessary for a reference 
count to be maintained for each object. Only reference count decrements need to be recorded, 
and the timestamps are adequate to convey that information. Thus, at 600, a timestamp is 
recorded for an object each time the reference count for the object is decremented The 
timestamp may be a counter that is incremented on every pointer deletion; It may be stored in a 
record generated each time a change is made to the graph structure. At 602, a gaibage collection 
is executed, the gaibage collection indicating one or more objects which are cyclic garbage. A 
tracing collector may be utilized to detect when objects are cyclic gaibage. Specifically, a mark- 
sweep collector may be used Then, at 604 the timestamps for each of the objects which are 
cyclic garbage are reviewed in reverse chronological order. For each timestamp>found, at 606, 
the object corresponding to the timestamp is indicated as dead. At 608, any object reachable 
from the object corresponding to the timestamp is also indicated as dead Then, at 610, any 
objects that have been indicated as dead are removed from the objects which are cyclic gaibage. 
The lifetime of the object may then be the period between the time it is created and the time it 
dies, the time it dies being measured by the time it was indicated the object was dead The 
reviewing may be repeated each time a gaibage collection is executed. 
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[0024] FIG. 7 is a block diagram illustrating an apparatus for measuring the lifetime of 
objects in a garbage-collected system, the objects organized in a graph structure, in accordance 
with a specific embodiment of the present invention. A memory 700 may be used to store the 
objects and other data stractures. A reference count maintainer 702 coupled to the memory 700 
maintains a reference count for each of the objects, the reference count indicating the number of 
incoming pointers to each object. A reference count updater 704 coupled to the reference count 
maintainer 702 updates the reference counts each time the graph structure is altered. A 
timestamp recorder 706 coupled to the memory 700 and to the reference coimt updater 704 
reconls a timestamp for an object each time the reference count for the object changes. The 
timestamp may be a counter that is incremented on every pointer store. It may be stored in a 
record generated each tinie a change is made to the graph strocture. A dead object indicator 708 
coupled to the reference count updater 704 and to the memory 700 indicates an object as dead 
when its reference count goes to zero. A garbage collector 710 coupled to the memory 700 
executes a garbage collection, the garbage collection indicating one or more objects which are 
cyclic garbage. A tracing collector may be utilized to detect when objects are cyclic garbage. 
Specifically, a mark-sweep collector may be used. A reverse chronological order timestamp 
reviewer 712 coupled to garbage collector 710 reviews the timestamps for each of the objects 
which are cyclic garbage in reverse chronological order. For each timestamp found, the reverse 
chronological order timestamp reviewer 712 executes several actions with subcomponents. The 
reverse chronological order timestamp reviewer 712 has a dead object timestamp indicator 714, 
which indicates that the object corresponding to the timestamp is dead. A dead reachable object 
indicator 716 indicates any object reachable from the object corresponding to the timestamp is 
dead. A dead object cyclic garbage remover 718 coupled to the dead timestamp object indicator 
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714 and the dead reachable object indicator 716 removes any objects that have been indicated as 
dead from the objects which are cyclic garbage. The lifethne of the object may then be the 
period between the time it is created and the time it dies, the time it dies being measured by when 
its conesponding reference count goes to zero or the time it was indicated the object was dead. 
Hie reviewing may be repeated each time a garbage collection is executed. 

[0025] FIG. 8 is a block diagram illustrating an apparatus for measuring the lifetime of 
objects in a garbage-collected system, the objects organized in a graph structure, in accordance 
with a specific embodiment of the present invention. In this embodiment, the reference counts 
are only examined when the garbage collection is executed Thus, it is not necessary for a 
reference count to be maintained for each object. A memory 800 may be used to store the 
objects and other data structures. A timestamp recorder 802 coupled to the memory 800 records 
a timestamp for an object each time the reference count for the object is decremented; The 
timestamp may be a counter that is incremented on every pointer deletion. It may be stored in a 
record generated each time a change is made to the graph structure. A garbage collector 804 
coupled to the memory 800 executes a garbage collection, the garbage collection indicating one 
or more objects which are cyclic garbage. A tracing collector may be utilized to detect when 
objects are cyclic garbage. Specifically, a mark-sweep collector may be used. A reverse 
chronological order timestamp reviewer 806 coupled to garbage collector 804 reviews the 
timestamps for each of the objects which are cyclic garbage in reverse chronological order. For 
each timestamp found, the reverse chronological order timestamp reviewer 808 executes several 
actions with subcomponents. A dead object timestamp indicator 810 indicates that the object 
corresponding to the timestamp is dead. A dead reachable object indicator 812 indicates any 
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object reachable from the object conesponding to the timestamp is dead. A dead object cyclic 
garbage remover 814 coupled to the dead timestamp object indicator 810 and the dead reachable 
object indicator 812 removes any objects that have been indicated as dead from the objects 
which are cyclic garbage. The lifetime of the object may then be the period between the time it 
is created and the time it dies, the time it dies being measured by when its corresponding 
referraice count goes to zero or the time it was indicated the object was dead. The reviewing 
may be rq)eated each time a garbage collection is executed. 

[0026] While embodiments and applications of this invention have been shown and 
described, it would be apparent to those skilled in the art having the benefit of this disclosure that 
many more modifications than mentioned above are possible without departing from the 
inventive concepts herein. The invention, therefore, is not to be restricted except in the ^irit of 
the appended claims. 



15 



